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Tho MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time maybe available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1)S Responsive to communication(s) filed on 8/1&2001 . 
2a)n This action is FINAL. 2b)S This action is non-final. 

3) n Since this application is in condition for allowance except for fonnal matters, prosecution as to the merits is 

closed in accordance with the practice under Expa/te Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) S Claim(s) 1-21 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) 13 Claim(s) 1-21 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)13 The drawing{s) filed on 16 August 2001 is/are: a)S accepted or b)n objected to by the Examiner. 
Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a), 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or fomn PTO-152. 

Priority under 35 U.S.C. § 119 

12)0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (0- 
a)n All b)n Some * c)^ None of: 

1 .□ Certified copies of the priority documents have been received. 

2O Certified copies of the priority documents have been received in Application No. . 

3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) 13 Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) □ Notice of Draflsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) [3 Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Informal Patent Application (PTO-1 52) 

Paper No(s)/Mail Date 2^. 6) □ Other: . 
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Detailed Action 



Claim Rejections - 35 USC § 102 



1 . The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed tmder the treaty defined in section 35 1(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published vinder Article 2 1 (2) of such treaty in the English language. 

2. Claims 1-6, 8-13, and 15-20 are rejected under 35 U.S.C. 102(e) as being anticipated by 
BdXdkrishxmi (U.S. Patent: 6J33,559). 

With respect to Claims 1, 8, and 15, Balakrishnan discloses: 

A method, device, and computer useable medium (CoL 5, Lines 41-55) for determining a 
speech-enabled application to receive a spoken utterance in a multi-context speech enabled 
environment conprising the steps of 

Evaluating a plurality of contexts for speech-enabled applications based upon an access 
characteristic (context-dependent arbitrator that gives higher speech command priority to an in- 
focus application, except for commands such as ''start'' or ''open, " which would be directed to 
an out-of-focus application. Col. 4, Lines 38'67)\ 

Receiving a representation of a spoken utterance (digitizing a speech input from a 
microphone and extracting features, Col 4, Lines 18-21)\ and 
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Directing the representation of the spoken utterance to a selected speech enabled 
apphcation based upon the step of evaluating the contexts (directing a speech command to a 
particular application based upon a confidence level relating to context, Col, 4, Lines 52-58). 

With respect to Claims 2, 9, and 16, Balakrishnan recites: 

Prior to evaluating the contexts, a step of creating the contexts for the speech enabled 
applications in the speech-enabled environment (created contexts based upon a focus state of a 
speech enabled application (foreground or background) utilized by an arbitrator to 
appropriately direct a speech command, Col 4, Lines 52-57, Furthermore, in order for the 
arbitrator to utilize the contexts, it would be inherent that there must have been some prior step 
of context creation to define the context states (foreground and background)). 

With respect to Claims 3, 10, and 17, Balakrishnan discloses: 

Identifying each context based on a persistent grammar (vocabulary that would be valid 
for all context states such as ''quit, Col. 4, Line 62), a foreground grammar (vocabulary 
appropriate when a command would be active, such as edit, that would be directed to an 
application in the foreground. Col 4, Lines 52-67), or a background grammar (vocabulary that 
would be associated with a background application such as ''start'' or "open, " Col 4, Lines 45- 
51) for each speech enabled apphcation, 

Balakrishnan further discloses a context-dependent arbitrator capable of distinguishing 
between different types of commands to identify a particular focus state and determining a 
confidence level indicator, based upon the focus state, in order to distribute a speech command to 
an appropriate application. 
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With respect to Claims 4, 11, and 18, Balakrishnan discloses: 

The step of evaluating contexts comprises prioritizing the contexts based on the access 
characteristic (context-dependent arbitrator that gives priority to an application based upon a 
foreground or background focus state, Col 4, Lines 52-58). 

With respect to Claims 5, 12, and 19, Balakrishnan recites: 

The access characteristic is based on recency of relevant access to the context (arbitrator 
that assigns a higher confidence score to an active and most current application in a foreground 
context state, Col. 4, Lines 52-58). 

With respect to Claims 6, 13, and 20, Balakrishnan discloses: 

The step of directing the representation of the spoken utterance to the one of the contexts 
comprises using a grammar to identify the selected context (application-specific vocabularies, 
which define acceptable commands, Col. 4, Lines 1-17, that enable a context-dependent 
arbitrator to identify and direct a speech command to a particular application in a foreground 
or background context, Col, 4, Lines 38-67). 



Claim Rejections - 35 USC § 103 



3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 
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4. Claims 7, 14, and 21 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Balakrishnan. 

With respect to Claims 7, 14, and 21, Balakrishnan teaches the application specific 
vocabularies (grammars), which determine acceptable commands, that enable a context- 
dependent arbitrator to identify and direct a speech command to a particular application in a 
foreground or background context, as applied to Claims 6, 13, and 20. Balakrishnan does not 
teach the use of a Backus Naur form grammar, however, it would have bee an obvious matter of 
design choice to utilize a Backus Naur grammar to define acceptable speech commands for a 
particular application context, since the applicant has not disclosed that utilizing a Backus Naur 
grammar form is for any particular purpose and it appears that speech commands could be 
sufficiently identified as being associated with a particular apphcation context with an ahemate 
grammar form. 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to apphcant*s 
disclosure: 

• Cox (US. Patent: 6J 92,3 39)- discloses a speech control system for multiple 
applications that distributes commands based upon a current focus state and 
performance parameters. 



• # 
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• Grant et al (U.S. Patent: 6,208,972)- teaches a speech-enabled control method for 
multiple computer applications capable of directing a command to an appropriate 
application using a context-based parser. 

• Van Tichelen et al (U.S, Patent: 6,311 J 59)- teaches a speech-controlled 
computer user interface that utilizes a Backus Naur grammar. 



6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James S. Wozniak whose telephone number is (703) 305-8669 
and email is James.Wozniak@uspto.gov. The examiner can normally be reached on Mondays- 
Fridays, 8:30-4:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Talivaldis Ivars Smits can be reached at (703) 306-301 1. The fax/phone number for 
the Technology Center 2600 where this appUcation is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the technology center receptionist whose telephone number is (703) 306- 
0377. 



James S. Wozniak 
5/1/2004 




PRIMARY EXAMINER 



